09) 



J 




Kecftsrene 



(12) 



Europaisches Patentan 
European Patent Office 

Office europeendes brevets (11) EP 0 721 169 A2 

EUROPEAN PATENT APPLICATION l&f 3//l</. Pljc 
(51) tnt CI. 6 : G06K 11/18 



(43) Date of publication: 

10.07.1996 Bulletin 1996/28 

(21) Application number: 95119532.0 

(22) Date of fifing:. 12.1 2.1 995 




(84) Designated Contracting States: 


(72) Inventors: 


DEFRGB 


• Levine, James Lewis 


Yorktown Heights, New York 10598 (US) 


(30) Priority: 05.01.1995 US 369011 


• Schappert, Michael Alan 


FlshWll, New York 12524 (US) 


(71) Applicant: International Business Machines 




Corporation 


(74) Representative: Rach, Werner, Dr. 


Armonk, N.Y. 10504 (US) 


IBM Deutschland 




Infoi iiialionssysteme GmbH, 




Paterrtwesen unci Urheberrecht 




70548 Stuttgart (DE) 



(54) Wireless pointing device for remote cursor control 

(57) . There is provided a hand held cursor controller 
system for use particularly with interactive television and 
computer presentation graphics. The system uses a 
hand held device with infrared tight emitting diodes which 
transmits to a detector attached to a processor. The infor- 
mation from the processor is transmitted to a television 



or video cassette recorder. The system allows for the 
positioning of a cursor on a television screen with the 
only input of the user being the aiming of the controller. 
It includes push-button activation and provides for the 
transmission of the usual controller codes. 
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Description 

BACKGROUND OF THE INVENTION 

Held of the Invention s 

The present invention relates generally to the field 
of user interactive media interfaces and. more particu- 
larly, to a wireless pointing device for cursor control in 
interactive television and computer presentation graph* w 
ics. 

Pescription, PMhe Prior Art 

A generally established method to provide human is 
interaction with a system controlled by a computer is to 
provide the user with a graphical display of choices and 
a pointing device, such as a cursor controlled by a 
mouse. The pointing device is used to manipulate the 
position of a cursor on the computer display or television 20 
(TV) screen to designate to the computer some desired 
action. The pointing device is usually provided with a 
computer-sensed button or switch, which can be pressed 
to cause the action to occur. 

There is a need for a selection device with the tunc- 25 
tional capability of a mouse, specifically the ability to (1) 
designate a displayed option for action by moving a cur- 
sor, and (2) initiate the action by pressing a button. For 
consumer applications, it is important that the device be 
intuitive to use. 30 

In the field of interactive television, the setting may 
be the home television room and the user may be any 
untrained member of the household. It is common for the 
user to be seated six feet or more from the television set 
and thus out of reach of any controls buiH into or con- ss 
nected to the television. In the field of computer presen- 
tation graphics, the setting may be a lecture room, 
classroom, or unprepared demonstration area, and 
those present who may have minimal training, may be 
standing or walking freely about the room. « 

The majority of pointing devices were developed for 
desktop use in conventional computing environments, 
and are poorly suited for the above applications. For 
example, a mouse, joystick or trackball is normally wired 
to the computer. The mouse requires a smooth, flat sur- 45 
face on which to roll, while the joystick or trackball must 
be fixed in a stable position for smooth operation. These 
devices also require some degree of fine muscle control 
and are difficult to use while standing or seated away 
from a desk. Furthermore, they are not intuitive devices, so 
so that untrained users may find it difficult to grasp the 
relationship between the cursor position and the hand or 
finger motions required to move it 

An alternative device which eliminates the wire is a 
joystick or trackball built into. a. handheld device. The ss 
motion of the ball or stick may be sent to the computer 
via an infrared (IR) or radio frequency (RF) communica- 
tion link. Such devices surfer from the other problems 



mentioned above and may require two handed opera- 
tion, a further disadvantage. 

Yet another alternative is a wireless hand held 
device equipped with an array of pushbuttons or a multi- 
element rocker switch. These do not require a stable sur- 
face, but they do require the user to remove his eyes from 
the screen to locate buttons. They are even less intuitive 
than the other devices, as the user is required to grasp 
the relationship between an arbitrary button and text or 
images displayed on the screen. 

US. Patent 4,565.999 to King et al. describes a light 
pencil". This is head mounted and used to steer a cursor 
by head motion. Four infrared light emitting diodes 
(I RLEDs) are used in the light pencil, with a single detec- 
tor at the screen. The IRLEDs are aimed somewhat off- 
axis in orthogonal directions and pulsed sequentially, 
allowing the received signal from each to be separately 
measured. The four values are used to compute an aim- 
ing direction. The light pencil, as described by King et 
al., lacks push-button function (head gestures are used) 
and has rather crude digital filtering to reduce cursor jitter 
caused by muscular tremors. The intent is to enable a 
person to position a cursor by turning the head in the 
desired direction. While such a device could also be held 
and aimed manually, the 'preferred embodiment as 
described in King et al. uses an awkward head motion 
(an abrupt nod) to initiate action after the cursor is posi- 
tioned. Other shortcomings related to the implementa- 
tion will be discussed below. 

SUMMARY OF THE INVENTION 

ft is therefore an object of the present invention to 
provide a wireless device to manually position a cursor 
on a display device by an intuitive direct pointing action. 

It is further an object of the invention to provide the 
pushbutton function of a standard computer pointing 
device and in such a way that the anticipatory and final 
motions involved in pressing the button do not affect the 
cursor position. 

it is also an object of the invention to provide a mech- 
anism for the transmission of binary codes to a remote 
television at negligible additional cost. 

According to the invention, there is provided an infra- 
red controller for an interactive device, such as a televi- 
sion or video cassette recorder (VCR). The device allows 
a cursor to be positioned merely by aiming the controller. 
It includes means for push-buttoh activation and option- 
ally provides for the transmission of the usual controller 
codes. 

The invention is a combination of the aiming function 
of a light pencil and the code-transmitting function of an 
infrared television or VCR controller, in which the internal 
mechanism of the controller is shared between the two 
functions. The innovative combination provides an intu- 
itive mechanism to position a cursor by rotating the con- 
troller in the desired direction, rt also provides for push- 
button activation of the action designated by the cursor 
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and optionally provides for transmitting television or 
other control codes. 

The invention makes use erf the principles of a tight 
pencil, with improvements in the data processing to pro- 
vide better performance, the addition of a new function 
in the form of push-button actuation, and further new 
functions allowing the transmission of standard control 
codes. In addition, a diffusion filter is added to smooth 
out irregularities in the LED output variation with angle. 
Such variations, if uncorrected, were found to introduce 
irregular variation in cursor motion with pointing direc- 
tion. 

The invention makes use of the optical technology 
of King et al. In a conventional infrared (IR) controller, a 
single infrared light emitting diode (IRLED) is used to 
transmit coded information in the form of a timed series 
of modulated pulses. According to the present invention, 
three or more IRLEDs are mounted in the hand-held 
device, with their optical axes tanned out from the main 
axis of the device. For example, one IRLED may point so 
down and to the left, the second may point down and to 
the right, and the third may point forward and up. Many 
other arrangements of IRLEDs are possible. The hand 
held device includes at least one pushbutton, referred to 
as the action button, but may include others. The action 25 
button is used to initiate an action responsive to the posi- 
tion of the cursor. 

An infrared detector is located in the general vicinity 
of the television or computer display. The IRLEDs are 
pulsed sequentially and the amplitudes of the light pulses 30 
reaching the detector are measured by a computer-con- 
trolled circuit connected to the detector. The light from 
an IRLED decreases progressively with an increase of 
the angle from its optical axis. Therefore, the relative 
amplitudes of the pulses will vary systematically with 
overall orientation of the device. The pointing direction is 
determined from the measured amplitudes, and used to 
position the cursor. 

Coded information is sent by adding additional 
pulses to the pulse train. These pulses may be applied 
to aH three IRLEDs to ensure reliable detection, or an 
additional IRLED may be used for this purpose. Any 
binary code may be sent in this way. One such code is 
used to indicate that the action button has been pressed. 
Additional buttons may be used to send other codes, «s 
enabling the device to emulate a two or three button 
pointing device and/or provide television-related control 
functions. 

BRIEF DESCRIPTION OF THE DRAWINGS . so 

The foregoing and other objects, aspects and 
advantages will be better understood from the following 
detailed description of a preferred embodiment of the 
invention with reference to the drawings, in which: ss 

Figure 1 is a high level block diagram illustrat- 

ing the basic components in practice 
of the invention; 
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Figure 2A is a block and schematic diagram 

snowing the transmitter electronics; 

Figure 2B is a schematic diagram of the trans- 

mitter showing the cfiverging IR 
beams: 

Rgure 3 is a timing diagram showing transmit- 

ted pulse sequences; 

Figure 4 is a block and schematic diagram 

showing the receiver electronics; 

Figure 5 is a graph of the transfer function 

showing the dependence of the rota- 
tion angle Ax on cutoff angle; and 

Fig. 6A and GB, taken together, are a flow diagram of 
the logic of the control program 
implemented by the microcontroller 
in the receiver shown in Figure 4. 

DETAILED DESCRIPTION OF A PREFERRED 
EMBODIMENT OF THE INVENTION 

Referring now to the drawings, and more particularly 
to Figure 1 . there is shown a hand held controller 1 , which 
emits infrared beams 2, and an optical receiving device 
3, which receives the infrared beams 2. A display device 
4 is connected to a computer 5 which also receives an 
input from the receiving device 3. The computer 5 may 
optionally be connected in a bidirectional manner to 
remote source 6. which provides data and/or images as 
part of an interactive system. 

There are two modes of operation. In the pointing 
mode, the transmitter IRLEDs are pulsed in sequence, 
each pulse consisting of a burst of short pulses at a fre- 
quency in the 30-50 Khz range. The controllers normally 
apply such pulses to a single IRLED. hence only minor 
changes are required to drive three or more IRLEDs in 
sequence. The amplitude of each pulse is detected in 
the receiver, which consists of a photodetector, tuned 
amplifier, and demodulator. The three or more pulse 
amplitudes are used to calculate an aiming direction. 
When a device, such as button 8. is pressed, an addi- 
tional pulse or pulses is sent out Detection of this extra 
pulse is taken as tine 'action" signal which may or may 
not be related to the cursor position, if desired, a second 
button can be used to send out yet another pulse or 
pulses, thus allowing the device to substitute for a stand- 
ard two-button mouse. 

tn the optional code mode, control codes are trans- 
mitted via one or more of the LEDs. Such codes often 
consist of a start pulse, a stop pulse, and from one to 
eight intermediate pulses to transmit a one byte code. 
Here, the device will first send out one more pulse than 
the maximum number used in pointing mode, the group 
then acting as a start pulse It win then send a code in 
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the usual way. This mode would be provided in order to 
eliminate the need for a separate controller. 

The hand held device, or transmitter, is shown in 
more detail in Figures 2A and 2a Figure 2A shows the 
electronic circuit diagram. Logic control element 7 mon- 
itors the state of pushbuttons 8 and drives IRLEDs 9 
through transistors 10. Control element 7 is preferably a 
permanently programmed microcontroller, which is both 
flexible and economical. A variety of commercially avail- 
able microcontrollers may be used, for example those 
being currently manufactured for use in hand held TV 
and VCR remote cdhtrol devices, tt will be apparent to 
one versed in the art that the function of the control ele- 
ment 7 can be implemented with discrete logic elements 
as well, tt will also be understood that while only two 
pushbuttons 8 are shown, there may be only one for a 
pointing device or there may be a plurality where the 
pointing device is incorporated into a TV or VCR control- 
ler. 

Electrical power is supplied by battery 1 1 , which may 
be rechargeable. In order to limit battery drain, the point- 
ing pulses would be started by pressing the pushbutton, 
and continue for some predetermined time. This time 
would be extended each time the button was pressed. 
The IRLEDs 9 may be LD242 diodes rhanufactured by 
Siemens, Inc. These components are mounted within a 
housing shaped to fit the hand, with at least one button 
located at the natural resting position of the thumb or 
index finger, as in the case of a mouse or trackball. 

Referring to Figure 2B, the IRLEDs are located 
behind window 12, which may be formed of any plastic 
transparent to infrared radiation. For aesthetic purposes, 
the plastic may be opaque to visible radiation. Proper 
operation requires that the radiation from each IRLED 
decrease smoothly with angle. Various artifacts resulting 
from the LED manufacturing processes may distort the 
radiation pattern. These effects are reduced by the addi- 
tion of optical diffusing fitter 13. Figure 2B also shows 
how the IRLEDs are arranged to provide three diverging 
but overlapping beams. While Figure 2B is a two-dimen- 
sional representation of the diverging beams, it will be 
understood that the divergence of the beams is actually 
in three dimensions with beams projecting into and out 
of the plane of the figure. The beams first converge onto 
window 1 2, so that any dirt or scratches will have approx- 
imately equal effects on each beam, then diverge. 

The operation of the transmitter may be understood 
with reference to Figures 2A and 3. Initially, control ele- 
ment 7 is in a passive state referred to as "sleep mode* 
to conserve battery power. When pushbutton 8 (or other 
activating device such as a motion sensor) is pressed, 
the control element 'wakes up" and begins transmission. 
Thus it will be seen that pushbutton 8 may serve only as 
an *on/off" switch, may serve as the action signal switch, 
or both. This sleep mode, is a . common function of a 
microcontroller intended for low power operation. After a 
lack of button activity for a predetermined time as set by 
the program, fa example 30 seconds, the processor win 
return to sleep mode. 



Referring to Figure 3, transmission consists of sev- 
eral pulse groups 14, which may be applied to one or 
more IRLEDs. Each group consists of a fixed number of 
individual pulses 1 5 at the center frequency of the detec- 
5 tion fitter. The pulses are applied to the IRLEDs through 
transistors 10 connected to output pins of element 7. 
These are switched on and off under control of a program 
stored in element 7. The program execution speed is 
fixed by a quartz crystal (not shown) connected to ete- 
io ment 7. hence frequency, group length, and inter-group 
spacing are all accurately controlled. In accordance with 
the general discussion above, a first group of pulses is 
applied to one IRLED, a second group to another, and a 
third group to the last When received, these pulses will 
T5 be used to position the cursor. When a button is pressed, 
one or more additional pulse groups are applied to one 
or more IRLEDS simultaneously. Sequence 1 6 illustrates 
a code transmission consisting of the binary bit pattern 
01100011, following three initial pulses. It will be under- 
go stood that there are many alternative ways of encoding 
without departing from the spirit of this invention. In par- 
ticular, the coded information can precede the pulses 
used to position the cursor. In this case, a special code 
may be used to indicate that position pulses will be sent 
25 In accordance with the method used to determine 
the pointing direction, yet to be discussed, the three 
IRLEDs should have approximately equal output power. 
Although it would be possible to hand-select sets of 
IRLEDs, a more economical procedure is to have control 
so element 7 adjust the effective power by control of the indi- 
vidual pulse widths. This requires a one-time measure- 
ment of intensities using, for example, the receiver 
described below. The correct pulse widths can then be 
calculated and stored in a nonvolatile memory in or con- 
as nected to element 7. 

As with a conventional TV or VCR controller, the 
receiver uses a narrow band tuned amplifier to minimize 
interference from stray light The infrared pulses are thus 
modulated at a matching carrier frequency. In addition, 
40 the receiver photodetector includes an optical filter with 
a rnoderatery narrow pass band centered on the IRLED 
emission. 

Figure 4 is schematic diagram of the receiver which 
consists of six functional sections separated by dashed 

45 boxes. These sections are a photodetector and transim- 
pedance amplifier 1 7. a tuned amplifier 1 8. a digital gain 
control 19, a diode demodulator 20, a smoothing filter 
21, an analog-to-digital convenor (ADC) 22, and a com- 
puting element 23. in that order.. Sections 17 to 21 are 

so based on standard operational amplifiers, using circuits 
well-known to those versed in the art Many alternative 
circuit arrangements can be used to perform both the 
general and specific functions. Computing element 23 is 
a conventional microprocessor with a control program 

55 stored in a read only memory (ROM), such as an elec- 
tronically programmable read only memory (EPROM). 
As illustrated here, the ADC 22 is actually a part of com- 
puting element 23, but an external ADC would be satis- 
factory. Similarty, computing element 23 could be a 
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complete computer system, as generally indicated in 
Figure 1. The ADC provides the means for the stored 
program to monitor the incoming optical pulses. 

The general operation of the analog section 1 7 to 21 
is descrtoed as follows. Arriving infrared pulses are con- s 
verted to voltage pulses 24 by photod elector 25 and tran- 
simpedance amplifier 17 and then fed to tuned amplifier 
18. Resistor 26 in series with the photod etector 25 
serves as a drain for low frequency photocurrents 
caused by ambient light fn the tuned amplifier 18, tuning io 
is provided by the inductor-capacitor feedback combina- 
tion to provide a center frequency of about 30 kHz and 
full bandwidth of about 600 Hz. Thus, only signals mod- 
ulated at a frequency close to 30 kHz are amplified and 
extraneous signals are rejected The output of section is 
18, in response to the input pulses 24, is a modulated 
burst 27 having zero average voltage. The signals are 
further amplified in section 1 9 with an amplification factor 
determined by the setting of electronic switches 29. The 
amplified pulses are rectified in section 20 to produce 20 
base band pulses 30. These are filtered in section 21 . 
producing smoothed pulses 31 . which are input to ADC 
22. 

The pulses are measured by computing element 23. 
using repetitive ADC samples of the signal voltage. 25 
These samples are repeated at a steady rate suff icient 
to follow the pulse waveforms. A pulse is considered valid 
if it remains above a small threshold value for a number 
of samples corresponding to the known pulse width, and 
then falls below threshold. After the leading edge is so 
found, a fixed number of sample voltages are summeeV 
to produce an average pulse height An equal number of 
samples are taken and subtracted during the inter-pulse 
period to remove any background signal caused by rec- 
tified noise and/or amplif ier offset Successive pulses are ss 
similarly detected, each considered valid it it begins and 
ends at the expected times. If more than three pulses are 
found, the extra pulses are interpreted as a code and 
their amplitudes ignored. The entire pulse sequence is 
rejected as invalid if an unexpected transition occurs. *o 

After each pulse sequence, the computing element 
23 adjusts the gain of section 19, by closing one or more 
of the switches 29 in the feedback path, in accordance 
with the maximum amplitude of the first three pulses. The 
object is to obtain maximum dynamic range from the <s 
ADC 22, which can be achieved H the largest pulse ampli- 
tude is just below the full-scale range of the ADC. Such 
adjustment is essential because the optica] signals 
decrease with the square of the distance from the 
receiver. In the absence of signals, the computing ele- so 
ment 23 increases the gain in steps, by opening the 
switches 29 in section 19, until either a signal is found or 
maximum gain is achieved. 

It is possible to calculate a cursor position from the 
measured pulses, such that the cursor would be posi- 55 
tioned at the point on the screen at which the device is 
aimed. This is not actually desirable, as precise cursor 
placement requires very fine motor control if the distance 
to the saeen is greater than a few feet A preferred 



method is to translate a fixed range of rotational angles 
into full screen motions of the cursor, independent of dis- 
tance. The cursor rtseH will provide visual feedback, and 
one can rely on human eye-hand coordination to make 
a final adjustment The method is described below. 

The rotation direction is calculated for the measured 
signals according to the following slightly idealized 
model. The emission from an IRLED decreases with 
angle and distance according to approximate formula: 

where, Ac. represents cutoff angle, beyond which the 
radiation is negligible. Consider first two identical 
IRUEDs offset left and right by angle Ao, If the pair are 
then rotated in their own plane, the signals win vary as 

A useful measure of the left-right rotational angle Ax. is 




This measure is independent of the distance, as desired, 
as wen as the actual power output of the IRLEDs. The 
dependence of Ax. on angle is shown in Figure 5 for a 
cutoff angle of 30*, for several values of the offset angle 
Ao. For this example, an offset angle of about 20* pro- 
duces a smooth variation of cursor position with angle 
over a comfortable range of rotation angles. 

The vertical position is obtained from the third 
IRLED, which may have a vertical offset angle equal to 
Aa Denoting the vertical signal by Sy, the vertical rota- 
tion angle fiy is calculated as 

Ay = SMSy+0.5<S/+Sr)) . (3c) 

The cursor coordinates & and are proportional to Ax. 
and fix respectively. 

Because of the visual feedback provided by the cur- 
sor, normal hand-eye coordination can provide excellent 
selection accuracy with minimal training. However, it is 
necessary to filter out the effect of hand tremor to avoid 
visible cursor jitter, while stiD allowing rapid cursor move- 
ments. These two goals are in conflict and cannot be 
realized with a conventional linear filter. A linear filter has 
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an inherent delay between input and output and this 
delay increases as the degree of filtering is increased. 
Instead, a nonlinear filter is required in which the degrees 
of filtering is decreased as the cursor velocity increases. 
The principle is that jitter wilt be less noticeable when the 5 
cursor is in rapid motion than when it is nearly stationary. 
If this type of filtering is done improperly, it can produce 
an annoying or even unstable feedback situation. 

King et al., gypJS. recommended switching between 
two digital (software) filters having different fitter con- 10 
slants, the switch occurring at a particular cursor velocity. 
Although this may have been suitable for a head- 
mounted device, it was found to be inadequate for a 
hand-held device, causing a jerky cursor movement. An 
improved filter was developed using continuously vary- is 
ing filter constants, tn addition, a special algorithm is 
applied to undo the sudden jump in cursor position 
caused by "hand-twrtch" when the button is pressed. 

The filter operates on unfiltered cursor coordinates 
(Xc. Yq) which are obtained every J_£ seconds, where Ts 20 
is the data sampling time. Filtered coordinates XI and Yf 
are obtained by applying a recursive low-pass filter 
described by the following equations: 

V7(f) = >7(f- rsH ^y 7 " 5 ) (4b) 

30 

In a conventional recursive filter, Nx. and Ny would be a 
constant and equal to a single constant N- Such a fitter 
would have a fixed cutoff frequency £c and a lag time t 
given by: 



1 



(2nNTs) ' 



where t = NTs 



(5) 



(s+vx): 



(7) 



During such rapid motion, jitter caused by hand tremors 
is not noticeable. At low velocity, the delay time and cutoff 
frequency become: 
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The degree of filtering increases in proportion of & H ti 
is made large enough to eliminate visible cursor jitter *> 
caused by hand tremors, then the cursor lag time will be - 
excessive. Instead, the value of H is made to decrease 
smoothly with increasing cursor velocity (Y& Vy). The 
velocity is estimated as: 

45 

Vx[f) a {Xc(t)-Xf[t-Ts)) (6a) 

. vvtOo(/c(f).yy(/-rs)) (6b) 

A smooth and well-behaved function for to is as follows: so 



It is evident that f& -» 1 for largess while - B for 55 
small V*. The equations for fcjy are identical. Substituting 
for the case where fJs -> 1. we find that Xt(t) » Xc(t) 
for large yjt Thus, at high velocity, the cursor will simply 
follow the pointing device coordinates without filtering. 
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A(2n)Ts 



(8) 



(9) 



The values of A and B. are adjusted empirically to obtain 
a good "feel", using the above relationship as a guide. 

The logic of the control program of computing ele- 
ment 23 is further shown in the flow chart shown in Fig- 
ures 6A and 6B. First, in Figure 6A, hardware and 
variables are initialized in function block 40. Variables are 
reset in function block 41 to start a new cycla A sample 
signal is then received in function block 42. In decision 
block 43, a determination is made as to whether the lead- 
ing edge of the signal is being received. If not the gain 
is increased by opening switches 29 in function block 44, 
and the process again samples the signal in function 
block 42. When a leading edge is detected, the signal is 
sampled N times in function block 45 and summed in 
temporary variable store maximum value. 

A test is next made in decision block 46 to determine 
if all the samples are greater than a threshold and a valid 
time for a pulse, if not the process loops back to function 
block 41 to reset variables and start a new cycle; other- 
wise, a valid pulse hasbeen received. A test is then made 
in decision block 47 to determine if three pulses have 
been received, one from each of the IRLEDs of the hand 
held transmitter. H not the process loops back to function 
block 42 to sample the signal in order to detect the next 
pulse. 

When three pulses have been received, the process 
goes to function block 48 in Figure 6B which interprets 
extra pulses as digital codes. In function block 49. the 
maximum signal value received is used to set the ampli- 
fier gain in section 1 9. Now the process of calculating the 
pointing location begins. In function block 50. As and Ay. 
are first calculated. The calculated values of Ax, and Ay 
are then transformed into Xj; and Y£ in function block 51 . 
yjS and Yy are calculated in function block 52, as 

Vx^XoXf. (10a) 

Vy« Y&Yf (10b) 

NX and £Jy are calculated in function block 53, as 



(B+Vx) 
(S+uy) 



(11a) 
(11b) 



Xi and yj are calculated in function block 54, as 



6 



11 



EP0 721 169 A2 



12 



NX 



Ny 



(12a) 
(12b) 



The new values of jg and ifl are fed back to function btock 
52 to continue the calculation of ¥xand \& At the same 
time, the calculated values of & and YJ are transferred 
to the cursor controller in function block 55 to move the 
cursor on the display. This process continues until the 
pointing position comes to rest at which time the process 
loops back to function block 41 in Figure 6A to await new 
pointing cursor signals. 

A problem common to "point and shoot" devices is 
that the act of pressing the trigger or button spoils the 
aim. for some people, anticipatory and largely involun- 
tary tremors may exaggerate the effect A solution to this 
problem is based on the idea that the cursor position will 
have stabilized a short time prior to the button press. 
Using a circular buffer stack in computer memory in func- 
tion block 55, a short list of prior cursor positions is main- 
tained After each button press, an algorithm is applied 
to the list to locate this stable point. The preferred embod- 
iment of this invention makes use of this techniqua 

Several variations of this invention can be created. 
Thus, while the invention has been described in terms of 
a single preferred embodiment, those stalled in the art 
will recognize that the invention can be practiced with 
modification within the spirit and scope of the appended 
claims. 

Claims - 

• 1. A hand-held pointing device for remotely controlling 
a cursor on a display device comprising: 
at least three infrared tight emitting diodes (IRLEDs), 
each of said IRLEDs aimed off a main or pointing 
axis of the device in different directions; 
at least one activating device on said hand-held 
pointing device; and 

a circuit connected to each of said IRLEDs for 
sequentially pulsing said IRLEDs wilh pulse trains 
so as to cause the IRLEDs to irefividuany and 
sequentially emit modulated infrared Tight signals to 
position said cursor. 

2. The device of claim 1 wherein said activating device 
transmits a control signal to cause an action to occur. 



3. The hand-held pointing device recited in claim 2 fur- 
ther comprising a plurality of activating devices and 
wherein said circuit is additionally responsive to said 
plurality o1 activating devices to generate additional 
control signals. 

4. The hand-held pointing device recited in claim 1 
wherein said circuit is responsive to said activating 
device to transmit a control code before said IRLEDs 



are sequentially pulsed, said control code indicating 
that position pulses are to follow. 

5. The hand-held pointing device recited in daim 1 tur- 
s ther comprising an optical diffusing fitter positioned 

to pass infrared light signals emitted from said 
IRLEDs to improve linearity. 

6. The hand-held pointing device recited in claim 1 
to wherein said circuit includes programmable means 

for storing calibration information for said plurality of 
IRLEDs, said circuit controlling an amplitude of 
pulse trains to individual IRLEDs according to the 
stored calibration data so as to cause said IRLEDs 
1 s to emit approximately equal amplitude infrared light 
signals. 

7. A remote pointing system for controlling a cursor 
location on a display device comprising: 

20 a hand-held pointing device for remotely controlling 
the cursor on the display device, said pointing 
device comprising: 

at least three infrared light emitting diodes 
(IRLEDs). each of said IRLEDs aimed off a main or 
25 pointing axis of the device in different directions; 
and 

a circuit connected to each of said IRLEDs 
responsive to a user input for sequentially pulsing 
said IRLEDs with pulse trains so as to cause the 
so IRLEDs to individually and sequentially emit modu- 
lated infrared Bght signals: 
a receiver and controller located proximate to said 
display device, said receiver and controller compris- 
ing: 

35 an infrared detector and amplifier tuned to a 

predetermined pulse frequency: 

a demodulator to convert received signals to 
analog base-band pulses; 

an anatog -to-digital converter to digitize the 
40 anatog base-band pulses; 

a digital processor to process the digitized 
analog base-band pulses as data representing a 
point of aim on the display device by the hand-held 
pointing device, said digital processor determining 
45 the position of a cursor on the display device. 

8. The remote pointing system recited in claim 7 
wherein said digital processor is programmed to cal- 
culate cursor position QC& Yc) as a function of rota- 
tion angles (Ax, AyJ. 



9. The remote pointing system recited in claim 8 
wherein said digital processor is further pro- 
grammed to calculate cursor velocity (YztU. Yrfti) 



Vx(Q*{XciiyXf{t-Ts)), and 
Vy[tl«(Yc{frYf(t-Ts)). 
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where &(t) and are respectively cursor X and 
X coordinates as a function of time, J£f and YJ are 
filtered X and Y_ coordinates, and Is is a sampling 
time. 

5 

10. The remote pointing system recited in claim 9 
wherein said digital processor is programmed to 
apply a digital fitter to cursor position data, said dig- 
ital fitter having a degree of tittering which decreases 
smoothly with cursor velocity. to 

11. The remote pointing system recited in claim 10 
wherein said digital fitter calculates X and Y filtered 
coordinates as: 



MO - Xf[t- Ts) ^ X ^-^ f ' Ts \ and (4b) 

where t& and Ny. are calculated as: 

where for Nj£-» J . Vx«g, and for -» 1 , V£»£, 
and 



is 



25 



where for Ny.-> | , Vy«B, and for My — > 1, Vy»& 

12. The remote pointing system recited in claim 7 
wherein the hand-held pointing device further com- 
prises one v more activating devices and wherein 
said circuit is additionally responsive to said one or 
more activating devices to generate control codes, 
said circuit pulsing all or some of said IRLEDs with 
pulse trains in accordance with said control codes 
subsequent to first sequentially pulsing said IRLEDs 
with pjise trains. 



13. The remote pointing system recited in claim 12 
wherein the activating devices of said hand-held 45 
pointing device comprise one or more pushbutton 
switches. 



14. The remote pointing system recited in claim 7 
wherein said circuit of the hand-held pointing device so 
includes programmable means for storing calibra- 
tion information for said plurality of IRLEDs, said cir- 
cuit controlling the pulse widths of said pulse trains 
to individual IRLEDs according to the stored calibra- 
tion data so as to cause said IRLEDs to emit approx- 55 
imately equal power infrared light signals. 
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